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(£) Method and apparatus for the testing and evaluation of geographically distributed 
telecommunication networks. 



CO 

m 



@ The dynamic functional behavior of geographically distributed fast packet switching systems, including those 
which accommodate high-priority circuit switched traffic and low-priorrty packet switched traffic, can be tested in 
real-time by sending test packets from one or more source nodes through the system to specific destinations 
that comprise a test packet analyzer. The test packets have the same structure as the data packets but in their 
payioad portion carry the entire Information required to perform the testing. The nature of that test Information 
depends on the characteristics of a set of predefined system errors the verification system is supposed to 
identify. 

For example, for detecting a specific set of errors encompassing packet loss, packet duplication, wrong 
packet sequence, packet at wrong output, packet corruption, packet length error, and unacceptable packet delay, 
the test Information would include an input address Indicating the source of the test packet, a sequence 
number defining the order in which the packet should arrive at the destination, time bits relating to the packet 
length and/or to the expected packet transmission delay, and a cyclic redundancy code which covers the entire 
contents of the test packet, including its control portion. 

Each analyzer at a receiving station operates autonomously from the senders and processes all received 
traffic in real-time: this enables it to recognize all defined system errors, even those occurring with very low 
probability, at the packet level. 
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This invention relates to a method an apparatus for the testing and evaluation of the dynamic functional 
behavior of geographically distributed high-performance telecommunication networks, in particular fast 
packet switching systems, under real-time operating conditions. The inventive teaching enables the 
detection of transient system errors with occurrence probabilities even below 10"^. 

5 The natural approach to test any system for correctness is to compare its output results with the 
corresponding results of an error-free "golden" system which operates under identical conditions. The need 
for the "golden" system and the assurance that it actually works free of errors, are the inherent problems of 
this approach. Another general solution is to compare the results of the system under test with precal- 
cutated lookup tables. The complexity of present-day telecommunication networks and the speed with which 

70 they are expected to perform, disqualify this solution because of the size of the necessary lookup tables 
and the time they require for the comparison. 

Since there exists no satisfactory solution to test sequential circuits in general, it is believed that test 
approaches that are restricted to a specific class of sequential systems are more successful. This becomes 
especially true if we will soon have to face the transition from VLSI to Ultra Large Scale Integration (ULSI) 

75 techniques with millions of equivalent gate functions on a single chip. Since computer-based simulation 
approaches that include the detailed timing of a low level system description fail because of the complexity 
and the high sequential depth of the target systems, the unsolved problem is the verification of the dynamic 
functional behavior of such systems. 

The central contribution of the present invention is that the dynamic functional behavior of hardware 

20 implementations of high-performance fast packet switching systems with data rates of 32 Mbit/s per line can 
now be evaluated in real-time. Since real-time approaches are orders of magnitudes faster than specific low 
level simulations, detailed behavior studies become feasible with reasonable turn-around times. 

These system evaluations are performed with a novel apparatus which itself Is based on a formal 
approach to testing the above class of systems. These systems have in common that they operate within 

25 certain speed ranges per external connection, and process packets of specific sizes and structure. The 
formal framework as well as the implementation consider the detection of transient system malfunctions, 
which originate either from design faults or from physical system defects, and may occur with an extremely 
low probability in the order of 10"^ or even below. The transputer-based architecture of the proposed 
implementation ensures an easy adaptability to switching systems of nearly arbitrary size (in terms of 

30 input/output numbers). 

The novel concept of detaching the environment model of the verification system (i.e.. the transmitter 
portion which is responsible for the transmission of the test data,) completely from the result analyzer 
portion, is the basis for the proposed apparatus for verifying and characterizing geographically distributed 
telecommunication networks and switching nodes of the size of Metropolitan Area Networks (MANs) and 

35 even Wide Area Networks (WANs). 

With the continuously increasing speed and complexity of networks and switching systems, formal real- 
time verification and characterization tools will become more and more indispensable. With some adapta- 
tions towards higher speed rates (Gbits/sec per line), formal evaluation approaches are attractive extensions 
for existing application oriented testbeds, such as the AURORA testbed. 

40 To more cleariy define the area of applicability of the present invention, a brief account of telecommuni- 
cation networks is necessary. In the past, the bottleneck in telecommunications networks has been the 
limited bandwidth of the transmission facilities. To optimize the use of the available bandwidths. two types 
of telecommunication networks have been developed which are strongly oriented towards the particular 
service they provide: 

45 (1) "Circuit-switched" systems provide fully transparent connections with fixed bandwidth and constant 
delay for the entire duration of the connection. Telephone networks with their stream-oriented traffic of 
voice communication are the classic application of circuit switching, and Space Division Multiplexing and 
Time Division Multiplexing are the most frequently used techniques in circuit-switched networks. 
(2) In contrast, "packet-switched" systems provide a Wrfua/ connection between two points of a network. 
50 which is established physically only during the transmission time of packets. This feature allows a better 
utilization of transmission resources than circuit-switched connections do. because the latter also remain 
established during their idle times. Characteristics of packet-switched connections are statistical mul- 
tiplexing, highly flexible bandwidth allocation, and a variable delay during transmission. 
Computer networks with their burst-oriented traffic characteristics are natural candidates for packet- 
55 switched systems. Conventional packet switches typically perform the switching functions by means of 
software processing on a general-purpose computer or a set of special-purpose processors. They provide a 
switching capacity of the order of one thousand packets per second with a nodal delay of 20-50 ms. 

Two considerations characterize the present-day development in the network area: One is the desire to 
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support the new applications emerging, such as digitized video and .mage commun.cat.on. other s the 
need for a single communications system which supports all services m an integrated and unified fashion. It 
has turned out that the most appropriate solution is a packet-switched system where ^l^^ 'f;;;^^^^^ 
to be transmitted Is brought into the form of "packets". The term packet describes blocks of data not 
exceeding apredetermined maximum length. Accordingly, to transmit voice in a packet-switched system^ 
fhe ^nTog voice signals must first be partitioned into blocks of the appropriate length, and digital messages 
exceeding the maximum length must be broken up into several packets for individual transmission. 

Advances in the development of semiconductor laser technology and glass fiber cables have led to a 
dras^cTncSase in the bandwidth of transmission networks to the order of GbiVs. Parallel to the progress 
fransmission technology, the trend in packet switching has gone from processor-based approaches to 
hardware-oriented switching systems capable of dealing with the bandwidth available V-^J^'^"^^^^^^^^ 
in very large-scale integration (VLSI) technology and improvements in the area of design -^^tt^o^^'^jy 
the opportunity to implement significant parts of an entire switching system on a ^'''f^J^^^ .^l^^J^ 
verification of a complex system starts in the design phase, it is an absolute requirement for the designer to 
use modern design tools to be able to manage the enormous complexity of VLSI ^es-gns^ 

Many high-performance fast packet switching techniques have been proposed and developed over the 
oast few years Examples representative of the large number of publications dealing with the subject are. 
Lut^. K A. "Considerations on ATM Switching Techniques". J. Digital and Analog Cabled Systems. 

. AhmIdrH^^Deilzerw.E.. Murphy. C.A.. and Port. E.. "A High-Performance Switch Fabric for 
integrated Circuit and Packet Switching", in Proc. INFOCOM 88, New Orleans. LA. Mar. 1988. pp.9- 

- Sgan. J.J.. et al.. "Fast Packet Technology For Future Switches". AT&T Technical Journal, pp. 36- 

25 - M^m^lT. De^e), W.E.. "A Survey of Modem High-Performance Switching Techniques.". IEEE J. of 
selected areas in communications. Vol.7. No. 7. Sept. 1989. , M^t^.^c:« 

- Tobagi. F.A.. "Fast Packet Switch Architectures For Broadband Integrated Services Digital Networks . 
Proc. of the IEEE. Vol.78. No.1. Jan. 1990. •x...k „« 

The two Ahmadi et al. references cited above in particular describe the specific type of packet switching 

" ^TXi^S^^^ ^ 9- delay no longer dictates circuit speed; interconnec«ons 
and Off cfJp communication delays represent far more important limitations. This leads to the cond^^^^^^^^ 
Zt Diacernent and routing of a circuit have a substantial influence on the dynamic functional behavior. 
theTm,^.^^^^^ placement and routing are not included in a HDL level representation, they cannot be 

35 vSed with ^?gh-level Simulation approaches. A complete verification of the ^^^^^r^TSei t^^^^^^^^ 
of abstraction in the behavioral direction be covered. After manufacturing, the system 'S te «or stuck at 
defects at the gate and switch level. However, stuck-at testing detects only permanent system defects. 

''T::'£lZi:;l:Zmc^ the preset invention to propose a method and an apparatus for the teeing 
^ and evaluation of' geographically distributed packet switching networks as '-9-'^ ^^[''l']^";;^ ^"^J^^J 
behavior. It is emphasized that a particular object of the invention .s to propose a rneti^od and appa^Uis 
that allow the term "geographically distributed" to encompass packet switching systems of the MAN 
(Metropolitan Area Network) and WAN (Wide Area Network) types. .... „ K-.h,.,i«r 

The present invention relates to a method for testing and evaluating the dynamic functional behavior of 
45 qeographSy iisTbuted telecommunication networks, in particular fast packet switching networks compns- 
" ng a p« o1 transmitting stations, receiving stations and communication links 

for the transmission of traffic organized in the form of packets, wherein the packets contain a control block 
and a payTo~^^ the latter being devoted to carrying the user information. The inventive method 

50 '""'"DefTr:ng7hrpS building blocks, such as paths, between the inputs and outputs of the 

network. . . .^.^^^ 

- Defining a set of target errors which the testing and evaluation is supposed to detect. 

- Passina during a testing and evaluation phase and/or during normal operation of the network, test 
Ss'around the nehTork which contain, in addition to the ■'-^<>''-^'^°y°ZZr^^^ tasT 

55 control block, in their payload portion all information relevant to their testtng and evaluation task. 

instead of the user information normally contained in said payload portion, and „^^„„^t«ri 

- AnSyzing the test packets arriving at the output port of their path of transmission for any unexpected 
results. 
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The invention further relates to a verification apparatus for testing and evaluating the dynannic functional 
behavior of geographically distributed telecomnnunication networks, which is characterized in that it com- 
prises a system environment portion, a result analyzer portion, a global controller and a test case generation 
portion, said system environment portion including a plurality of transmitters associated each with an input 
5 port of the packet switching network to be tested, said result analyzer portion including a plurality of 
receivers each respectively associated with one of the output ports of said packet switching network. 

Details of the inventive method as well as of an embodiment of the inventive verification apparatus will 
hereafter be described by way of example with reference to the attached drawings in which: 





Fig, 


1 


shows a N^xN^ switch which is built of 2N (NxN) switching modules; 


10 


Fig. 


2 


shows the architecture of a shared bus type switching system; 




Fig. 


3 


shows the general architecture of a shared memory switch; 




Fig. 


4 


shows packet-switched traffic in a unified manner; 




Fig. 


5 


is a visualization of a typical packet switching scenario; 




Fig. 


6 


illustrates the basic structure of a Switching Fabric Element; 


15 


Fig. 


7 


shows Control Block and a Payload Portion of the packet structure; 




Fig. 


8 


is a schematic sketch of a schedule file representing packet-switched traffic; 




Fig. 


9 


shows the relationship between a^ax and the test length &Ho.T for three probabilities Q; 




Fig. 


10 


shows the overall structure of the verification system; 




Fig. 


11 


illustrates the organization of a transputer; 


20 


Fig. 


12 


shows the architecture of the testing-based verification system in accordance with 








Invention; 




Fig. 


13 


is a block diagram of £i typical transmitter hardware; 




Fig. 


14 


is a block diagram with the basic components of a receiver; 




Fig. 


15 


shows a block diagram of a sequence number checker; 


25 


Fig. 


16 


shows the different sources used for the test case generation; 




Fig. 


17 


illustrates a message consisting of 16 test packets. 



While the design of fast packet switching systems as such is not a subject of the present invention, it is 
appropriate to briefly reflect on the features and operation of these systems, and to touch on the initial 
-static- testing of their components in order to provide a clear definition of the terms used below to describe 
30 the invention. 

The packets containing the information to be transmitted usually have a maximum length of 32 bytes. 
Their structure includes a control field for the destination address and for a typebit indicating the packet's 
priority level, and a payload field containing the user-relevant information. In the telecommunications field, a 
packet switching method known as Asynchronous Transfer Mode (ATM) is starting to become a CCITT 

35 Standard. It specifies fixed-length packets comprising 48 bytes of data and 5 bytes of control information. 

Common characteristics of fast packet switching systems (FPS systems) are a high degree of 
parallelism, distributed control, and routing performed at the hardware level. A fundamental feature of FPS 
systems is the necessity of storing packets in order to avoid losses if several packets are simultaneously 
destined for the same output. Three basic types of packet switching concepts can be distinguished: 

40 • The shared memory type, 

• the shared medium type, and 

• the space division type. 

Independent of the switching concept chosen, the technology used to implement the switch on an 
integrated circuit chip places certain limitations on the design of the switch In terms of input/output ports 

45 and speed. Therefore, large switching networks are built up of modules in single-stage or multi-stage 
configurations. Fig. 1 shows a N^xN^ switch which Is built of 2N (NxN) switching modules organized in two 
stages, where N denotes the number of Input and output lines of the switching system. This switch offers a 
single Internal path from every input to every output. There exist other multistage configurations which offer 
multiple paths from Input to output ports. 

50 Shared medium type switches typically employ a high-speed parallel bus or ring network as the 
switching medium. All packets arriving at the input lines are first converted from serial to parallel (S/P) and 
are then (usually) synchronously multiplexed onto the shared medium. The bandwidth of the shared 
medium (typically bus or ring) must be N times the bandwidth of a single input line. 

Fig. 2 shows the architecture of a shared bus type switching system. Each output line Oi ... On is 

55 connected to the shared medium (time-division bus) via an interface that consists of an address filter (AF), 
an output FIFO (fist in/first out) buffer, and a parallel to serial converter (P/S). Depending on the destination 
address of each packet, the address filter determines whether the packet observed on the bus Is written into 
the FIFO buffer. Principally, the address filter operates as a demultiplexer. Since packets may be switched 
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simultaneously from all inputs to one output, the address filter and FIFO buffers must also manage N times 
the bandwidth of a single line. If this condition can be fulfilled together with the bandwidth requirements of 
the bus the shared medium type switch is non-blocking. The bandwidth capacities of the shared medium 
(ie the bus or ring) and of the memory (i.e.. the FIFOs) are the major limitations of the size and 
extendibility (i.e.. the number N) of realizable shared medium switches. The total amount of buffer memory 
fs equally distributed among all output lines. A dynamic sharing of this memory to assist heavily loaded 
outputs temporarily is not possible. The buffer size is the critical parameter determining when under heavy- 
load conditions a buffer overflow will occur, which results in packet loss. 

The kernel element of shared-memory type switches is a single dual-ported memory which is shared by 

,0 all input and output lines. Packets arriving on the input lines are multiplexed (MUX) Into a single strearn 
which is fed to the common memory for storage. Internally to the memory, the packets are organized in 
separate (virtual) output queues, one for each output line. The control information that determines the 
packets' output destination is extracted from the packet header and transformed into an appropriate 
memory address. Simultaneously, packets are retrieved sequentially from the memory, demultiplexed 

,5 (DMU)q, and transmitted over the output lines. The general architecture of a shared memory switch is 

^''Tcorcern with respect to the shared-memory concept is whether the processing time required to 
transform the header information into a valid memory address and to issue the P^P^;';^;*;^' ^^"^^ 
enqueue the packet, is sufficiently small to handle all incoming lines simultaneously A cen ral controMer 
capable of processing N incoming packets and selecting N outgoing packets in each ime s'ot. -s required 
Consequently, the memory is accessed N times per slot for enqueueing P/^^^f }^!^J°' 
dequeueing packets. If we assume V to be the speed per port, then the required bandwidth for the shared 
memory rSust be 2NV. For example, in a 16x16 switch with a line speed of 32 Mbit/s. the memory 
bandwidth must be at least 1 GbiVs. The corresponding access (i.e. read or write) cycle time for a memory 
with an 8-bit-wide data bus is less than 8 ns. Given the limitation on memory access speeds, the required 
memory bandwidth can be achieved by means of parallel memory organization. In a bit-slice organization, 
for examole, each bit is written into a separate memory. 

The finite size of the memory may prevent some packets from being accepted by the switch and cause 
them to become lost. Therefore, the memory size must be chosen such that the packet oss rate does not 
exceed a certain maximum. The size of the memory required is a function of the size of the switch (N) he 
offered load, the traffic pattern (bursty or equally balanced traffic), and -this is very important- of the way the 
memory is shared among the output queues. Principally, there are two possibilities: 

o Complete partitioning. In this case, the memory is divided into N separate partitions, each or^e 
allocated to a particular output queue. A packet is lost when an overflow condition at a single output 
36 queue occurs, independent of the contents of other queues. 

o Complete sharing. In this case, all output queues can share the entire memory. A packet is lost only .f 

u^dl^l'\^stmp«onVoI equal memory size, traffic load, and traffic pattern, a ^^'t^f ^^^^Vf "^Pl^y^ 
complete Sharing policy shows a significantly smaller packet loss rate than a switch with comptete 
« paSonfng. Hen^e.'com'plete sharing approaches lead te switching ^V^^^^J,^ ^-^^-^^^^^^^^ 
requirements. Nevertheless, some problems may occur in connection with bursty traffic « P^^s^^^^^^ 
example, that some heavily loaded output queues occupy the entire shared memory and thus block the 
traffic on other paths. A sharing policy with minimum and maximum allocation constraints could bypass this 

45 ^'"''in'^ontrast to the shared-medium and shared-memory concepts, where the traffic from all inputs is 
concentrated in a common resource operating with N times the bandwidth of a 

type switches establish multiple concurrent paths from inputs to outputs, each ^^-"^^ ^ ^^^^^^ 

for a single line. Fig. 4 shows a common model of a space-division switch. Depending t^e^ternal 
suucture of the switch, it may be impossible to set all required paths simultaneously. This characteristic. 

so called internal blocking, is the main cause for throughput limitations. 

Internally blocking switches cannot buffer packets at their outputs. Buffers must be located at t^e P tec^ 
where the potential conflict occurs, or upstream (e.g. at the inputs). For each input ''^-j;;- '^Vri, ne 
demultiplexer) which routes the packets to N separate buffers, one for ^^^^^^^^^ 
there is a concentrator (i.e. a multiplexer) which connects all buffers associated f ^ * J^^^'^f^^^^^^ 

55 appropriate output line. Thus the space-division switeh consists of N routers. N con^"''«tors and N 
bSSers. The conventional space-division type switches differ in the way the router and concentrator are 
imolemented and in the location of the buffers. „«„„^„.» »r.H 

After this introduction to prior art FPSS approaches, the description now terns to the concepts and 
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architecture of the novel testing method for high-performance switching systems in accordance with the 
present invention. 

Local telecommunication switching systems of the future must support a variety of interfaces, such as 
ISDN services, high-speed LAN interconnections, and high-performance workstations. The idea is to have a 
5 switching system which is able to cope with circuit-switched as well as packet-switched traffic in a unified 
manner. A visualization of a scenario with the desired features described above is shown in Fig. 5. Circuit- 
switched traffic must be handled with priority, because there exist welt-defined limitations on the length of 
time this kind of traffic, e.g. voice, may be delayed In a switching node. 
The switching system consists of two major components: 
70 • the Switch Fabric Adapter (SFA) and 

• the Switch Fabric Elements (SFE). 

The function of the SFA is to convert user information, which may be in the form of packet-switched or 
circuit-switched traffic, Into uniform fixed-length minipackets at the input side of the switch, and to 
reassemble these minipackets to their original traffic type at the output side. Hence, external users are 

75 completely unaware of the Internal minipacket mechanism. Minipackets of circuit-switched connections have 
priority over minipackets of packet-switched connections. The size of a minipacket is assumed to be 32 
bytes including the header which contains the routing information. The term "minipackets" was chosen to 
prevent any confusion with ceils as defined in the ATM proposal. However, the only difference Is in the 
actual size of the packets (here 32 bytes, in ATM 53 bytes). For all basic considerations, a cell and a 

20 minipacket are identical. 

The Switch Fabric Elements (SFE) are the basic building blocks which collectively make up the Switch 
Fabric (SF) network. The SFE is responsible for the switching of the minipackets. One SFE is integrated on 
a single chip and serves as a module to form fabrics of arbitrary size and complexity. The basic structure of 
an SFE is shown in Fig. 6. It consists of two major components: a self-routing segment 10, 1 1 and an output 

25 queueing segment 12, 13. A self-routing segment, which has the form of a binary tree, is used for each 
input to transport the minipackets to the correct output. One bit of the destination address at each level of 
the routing tree Is sufficient to determine the way to the next level. For a 16x16 switch, four levels are 
necessary for the routing tree. 

The minipackets can be routed in a simultaneous fashion between all input-output combinations without 

30 causing any conflicts. Since this is equivalent to freedom from internal blocking, output queueing is 
sufficient for these switches. Conceptually, this is a space-division type switching system with N^ disjoint 
paths among inputs and outputs. The interface between the self-routing segment and an output line consists 
of shift registers SR, which can hold a single packet for intermediate storage, and a pair of FIFO queues, 
which constitute the output queueing segment. 

35 Since two different priorities must be handled, namely for voice and data, it is necessary to provide two 
independent output queues. The importance of the shift registers is to ensure that no packets are lost 
during the time a round-robin controller transfers the minipackets sequentially to the associated output. 
FIFO. This task corresponds to the concentrator function of the general space-division model in Rg. 4. The 
controller and the FIFO elements must provide a bandwidth of N times the bandwidth of a single line. The 

40 speed on each port Is assumed to be 32 Mbit/s. One SFE Is a chip with a complexity of 10^ transistor 
functions (or approximately 10^ equivalent 2-input gate functions). Including a 64 kbit memory. This huge 
amount of memory Is responsible the high sequential depth of these devices. 

Given the complexity of the switch fabric elements, of the switching fabric and of the entire switching 
network, it is mandatory to make sure that the whole system and its parts live up to expectations. The 

45 process employed to generate that certainty is called "Verification". It is a test as to whether a system 
performs the intended functional behavior correctly. A design or system is correct if it is possible to prove 
that its implementation realizes the specifications. A complete design verification includes all different levels 
of abstraction and all possible directions. Different approaches are known to verify a system design: 

• Formal verification tries to prove the correctness of a design by formal reasoning based on the 
50 existing design documents. 

• Verification based on simulation means to construct a system, called model, which behaves like the 
Intended system, i.e., verification based on simulation means to analyze whether the modelled system 
has produced correct results from the offered input. 

A complete verification system based on simulation consists of the following main components: 
55 • an executable model of the system under design, 

• an executable model of the system environment, 

• a result analyzer, and 

• a global control unit for the system environment and the result analyzer. 
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The credibility of a verification based on simulation depends on all components models involved. 



the switching system, 
o A packet is lost, 
o a packet is duplicated. 
20 o packets arrive in the wrong sequence, 
o a packet arrives at the wrong output. 
^ a packet arrives with the wrong packet length, 
the contents of a packet have been corrupted, or 
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One conclusion of this fact is that a verification system must be able to provide various input ports of PSSs 
with test data. 

The next question Is how to distinguish, at a primary output of the switching system, between packets 
that have been switched correctly and those which have not. Somehow the result analyzer of the verification 

5 system must know what a correct packet looks like and in which sequence the packets should arrive. 

A common approach is to send the same test data, inserted at the primary inputs to the system under 
test, around the system to the side of the primary outputs and then compare the actually processed data 
with the expected data derived from the external transmission. In our case, the target system is a hardware 
prototype implementation of a high-performance FPS system which means that the verification is performed 

10 under real-time conditions. A requirement for the external system is a high-speed link which transmits the 
test data from all input ports to the output side of the target system. The bandwidth of this high-speed link 
must be m X 32 Mbit/s where m is the number of inputs of the switching system and 32 Mblt/s is the 
bandwidth of a single input port. Even a system with few inputs (m = 16) would exceed the technological 
possibilities to implement such a link. Another nontrivial problem is the control mechanism to attach the 

75 single input ports to the high-speed link and to compare the results from the switching system with the 
externally transmitted data. 

During testing, no user information is transmitted in the payload part of the packets. This means that 
this empty space can be used for test purposes. In accordance with the invention, It is suggested that the 
payload portion of a packet be used to transmit pertinent test information during testing. 

20 In general, a packet comprises a Control Block and a Payload Portion as shown in Fig. 7. The Control 
Block of a packet contains the destination address (OUTPUT Address) and a TYPEbit that indicates the 
priority of the packet. The Payload Portion is used to transmit the user-relevant information. For test 
purposes, additional information is inserted in the payload portion at the input side of the switching system, 
and the contents of the arriving packets are evaluated at the output side. 

25 Specifically, in the payload portion an INPUT Address (Indicating the source of the packet), a 
SEQUENCE Number, TIMEbits, and a CRC code (Cyclic Redundancy Check code) that covers the entire 
packet including the control block, are inserted. The remaining bits in the packet are randomly filled with 
logic zeros and ones. Thus, each packet contains sufficient information to detect every error listed above. A 
confrontation of the various portions of a packet with the errors they are to detect is shown In the table 

30 below. 



Packet Structure versus Target Errors 


Part of the Packet 


Target Error 


SEQUENCE Number 
INPUT Address 


Packet Loss 
Packet Duplication 
Packets in Wrong Sequence 


OUTPUT Address 


Packet at Wrong Output 


TYPEbit 


Packet with wrong length 


TIMEbits 


Unacceptable Packet Delay 


CRC 


Corrupted Packet Contents 



45 

Error detection is performed by analyzing the arriving packets at the output of the assumed fault path 
for unexpected contents. In order to be able to distinguish between correct and Incorrect packet contents, it 
is necessary to store information on previously received packets. 

For example: An important check is whether all packets originating from the same source (i.e. the same 

50 input port) arrive in the same sequence as they were sent out. Since packets may be sent from every input 
to every output of the PSS, it is necessary that the expected sequence numbers of packets from all 
possible Inputs are stored separately at the output of the assumed fault path. Whenever a packet arrives, 
the actual sequence number in the packet is compared with the expected number corresponding to the 
input address of the packet. A detailed description of the operation of the error checker will be given below. 

55 As already mentioned, it Is not necessary to restrict the number and location of simultaneously existing 
faults in the switching system. All faults on those paths that either have the observed output Ok as 
destination address, or that cause a misrouting of packets from any other path to the output Ok. are 
detectable during the observation of a single output Ok. Faults that misroute packets with the destination 
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address o. to another output are detected as "packet loss" errors. Faults that misroute packets frorr, an 

inpulpor^mrbe ensu' ed that the total traffic load does not exceed the maxirnum capaaty of the output 
' '°\hile It has been shown above that a single test packet ^P-'!;'"'^^^^^^ '^is 

wJler the swftcrng s has performed its task correctly. Sequences of test packets s.multaneously 
,0 TenUrom L'r^^^^^^^^^^^ and under various loads are required in order to evaluate the 

"^'j!:-::^:::!^^^^^^ mto the payoad portion ofa test packet (that does not have to carry 

user rrr^Son allows the testing and evaluation of widely ^'^'^'''f-' P^^fJ ^^^^ "^^^ 
no other link to the destination of the packets Is required than .s contamed m f ^^llf ^^^^^^^^ 

- .oarron::rc?:pS*^^^^^^ 

SiaTa distinSt be made between abstract and executable test cases. The user has to «P«^'^ ^bs^^ttest 
cases ^ Te orm of a particular test method. An executable test case is derived from abstract test case 
Sd is I TiZV^ allows it to be run on a real tester for testing a real implementafon of the system under 

'^^Therefore a formal notation is here provided which allows abstract test cases to be specified for a 

Sr^t test caTes Tgiven below. The implementation of the tool to generate the executable test cases .s 
'"TnTdeTtrspedfy test cases in a formal and abstract manner, use will be made of well-known 

TtestcarFrrrof an/the properties of the switching system under test must be specfed. The s,ze and 
switch. An example of such a specification of a switch configuration might look like this. 
35 configdef Example^Switch; 

totalinports = 16; 
totaloutports = 16; 
totalstages = 1; 



25 



30 



40 



45 



50 



econfigdef 



The functional primitives that are assumed to be faulty in a system-level ^^j;:^^^^^^^^^ 

low-priority), and that all have the same source and destination address as a message. An example 
specification of a message for a specific path and priority might look as follows: 



55 
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message hp_example; 

switch = "Example^Switch''; 

^ priority = high; 

path = ( inport 1 to outport 9 ); 

packets = 8; 

70 

emessage 

For each path involved in a test run, a separate message has to be specified. Finally, the traffic loads 
with which the specific paths are to be stressed must be determined. A specific load is established by 
75 performing a scheduling of the test packets. An example of such a schedule file is shown below: 

scheduledef Test; 

20 usemessage mesO - ''\hypertest\hp_example'', 

mesi = ''\hypertest\lp_example"; 

transmitter 0; 

highpriority (mode = retransmit, totalslots = 4*64); 

slot < i == 0 step 64 for 4> /* We want 4 frames a 64 slots V 
slot <) = 1 for 16 > /* Insert in 16 slots of each frame... V 
30 j: mesO; /* a packet of message mesO. */ 

eslot; 
eslot; 
ehighpriority; 



35 



40 



45 



lowpriorlty (totalslots = 32); 
slot < i = 0 for 32 > 

i: mesi; /* Send all packets in a burst. V 

eslot; 

elowpriority; etransmitter; 
escheduledef 



The statement "mode = retransmit, totalslots = 4*64" indicates that it is intended to send a continuous 
stream of traffic in repetitive cycles of 256 slots (one slot has the size of a single high-priority packet). The 
basic scheduling of the packets is performed in two nested loops. The first loop partitions the 256 slots into 
50 four frames of 64 slots. The inner loop forces the first 16 slots of the frame to be filled with packets of the 
message mesO. Slots that contain no packets of any message are handled as pauses. This schedule file 
represents traffic as shown in Fig. 8. 

High-priority packets (voice traffic) are transmitted in periodic frames while low-priority packets 
(computer data) are transmitted in bursts. Combining several such or similar kinds of traffic, each sent from 
55 a different transmitter to the same destination, into one schedule file, offers the possibility of defining 
complex test cases in a clean, formal, and readable manner. 

In order to verify the dynamic functional behavior of a PSS. a number of packets is sent through the 
system and a check is made at the output side whether the packets have the expected contents. However, 
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70 



75 



it is not practicable to cover the input space exhaustively, because this would actually mean having to 
assign Impossible variations of packet patterns under all possible load cond.t.ons to all .nputs of the 
switctHngsyster. ^^.^^^.^^^ ^^^^^^^ .measure the P-''^J:|"yJ^; 
outstanding system malfunctions (e.g.. the error probability for a packet loss .n system X ,s 10 ) The 
oroblern here is to characterize a system if no errors are detected within the testing period or if the 
rmbsT of detected errors is too smaSto allow reliable statistical statements. In these cases, an information- 
theoretical approach to the verification can provide a solution. 

in ^atisti^l testing, the presence of a fault corresponds to a non-zero probability of error in the ou^"»^ 
in thelo Sl^g the adaptation of the information-theoretical analysis to packet switching systems .s 
perfled and ii irdeterm'ined how long the test method described must be applied to achieve a certain 
amount of confidence in the correctness of the design. 

When a packet switching system is supplied with an information rate of H, bits per packet at the 'npu^ 
the l^ation rate at the output is H„ bits per packet, and If the PSS contains no '"J^^^'^j;^^^^^^^^^^ 
Ho cannot exceed H, (H^ H,). The actually delivered output rate "'o "° ' """^ 
of the outDut packets are assumed to be incorrect due to system defects (H o<HoSHi). „ 

Forrpacket o'n bit length, there exist 2- possible packet patterns. The statistical information per 
packet is defined by Shannon via the occurrence probabilities p, of each packet pattern i to 



20 2^ 



25 



30 



35 



i=1 

For a given input source, a fault-free system can produce 



correct packet sequences of the length T. each with almost equal probability, in ^'^^^"^^^inolat'^ ^^^^^ 
theorem' and its accuracy improves as the length T of the sequences increases. "9 th^ a^^^^^^^^ 

defect reduces the information of each packet by a fraction a to Ho - d - «)Ho . then the correspono g 
number for the faulty system is 



2{l-«)HoT 



sequences of the length T. The probability for a faulty system (i.e.. 0 < a :S 1) to deliver a sequence of 
^ SS packets. which'is equivalent to the probability that the system fault has not been detected, is 



P ( test passed | a ) = jrf 

^ 2"° [2] 

2"°' 



so 



55 



This probability goes to zero as T is increased, i.e. the .^^^^^J^^"^^^ 
detect the fault! Also, the probability decreases at a faster rate, the higher the ate of Ho . ^^'s fact aj ows 
S following Ldusion to be drawn: In order to detect a defect in a system, it is recommended that the 

prlS^rretr:;^^^^^^^^^^^ integration over a., possible values of 
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P( test passed ) = (Wd" = ^H^inT 

5 

Equation [2] presents an expression for the probability of a system passing the test under the condition 
of a present fault. Using Bayes* rule 

P(A|B)P(B) = P(B|A)P(A) 

10 

and equations [2, 3] one gets an expression for the probability density that the information reduction is a 
under the condition that the system has passed the test: 

r I . . M ^ P ( test passed | a) p(a) 

p ( a test passed ) - — - — — [4] 

^ P ( test passed ) 

In the absence of any a priori knowledge of the probability density p(a), it might be reasonable to 
20 assume that a is uniformly distributed (i.e., p(a) = 1) in the interval [0;1]. Together with the substitution of the 
results of equations [2. 3] one obtains: 

2~*"°^ HqT In 2 
25 P ( a I test passed ) = ^ — * 

The probability that the information reduction a due to system defects will not exceed an upper bound 
of ctmax under the condition that a packet sequence of the length T detected no error, is calculated via the 
30 integral over the density function in equation [5]: 

O ( ocmax ) = P ( a ^ a^3x I test passed ) 
p ( a I test passed ) da 

0 

1 - 2" Jo 

4Q -I 2~ *max^o^ 



35 



1 - 2" "^"^ 



45 



Equation [6] is now resolved such that a^ax is a function of HqT with Q as a parameter: 



50 



ln(l - (1 -2""^'^)q) 



"^3X , H T \ 

ln(2 ) 

55 

For Ho:T»1, the 



[8] 
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2- "oT-term 



in 



s 



10 



the dividend can be neglected. The extraction of HoT from the divisor finally leads to: 

'n(1 - Q) 1 [9] 
"max - _ In 2 HoT ■ 



Fig 9 shows the relationship betv/een and the test length HoT for three probabilities Q The term Q 
is the degree of confidence that an undetected system fault will produce incorrect output 2 ^we 

of less than a^Ho bits per packet or per time unit. Since each packet contains Ho bits o information we 
cLn So*nterp7t al as'the'probabilitj of receiving an incorrect packet, or as the probabihty of the system 

" *° 'Equation [1] indicates that a packet stream delivers a maximum amount of '"'°;'"««°" P**; P^^^"^^* " 
each Jacket pattern occurs with the same probability. This means that the probabiHty es^^^^o^one 
TzBto is equal to one half. As mentioned above, the sequence number, input address, ^'-^^bits. and ^^^^^^ 
Le Tn a packet are required to detect malfunctions in the switching system. To examme the impact of 
SSse entries on the content of the information, a packet is regarded as a bit stream. Observing on^y one 
output 1 first bits of each packet contain the output port address which is always identical. Thus the bits 
*at represent the output port address contain no information in the sense of Shannon's definmon^ (An 
exceZn is the case that a packet arrives at the wrong output. Since this event ,s assumed to have a sma I 
pSba'X Of occurring, its mean content of information is -^-ected.) The type b^^the ^^ 
the inout address the time bits, the remaining empty space in a packet, and the CRC code are regaraea 
ove the ifng term equally distributed and therefore contribute significantly to the informafon content per 
packet (The long-term view is required to meet Shannon's definition of statistical information.) 

When n is the bit length of the output port address, and N the bit length of the entire packet, then the 
maxZm intimation at one output is N - n bits per packet. If the special pragmatic entries 
number, etc.) do represent equally distributed bit pattems in the long-range view, this results in packets with 
the maximum possible amount of information per packet. „^^..„t^ «« 

Si^ce hiqh-priority and low-priority packets have different lengths, they contain different amounts of 
informron When Sh types of'packets appear in a long test sequence with equal probability, the mean 
content of information per packet is calculated to be: 



. 20 



25 



30 



35 



40 



45 



Ho = 



56 + 248 . ^ 152 bits per packet , [10] 



where 56 ( = 64-8) bits per packet is the maximum achievable information of a high-priority packet and 248 
r= 256-8) bits per packet is the maximum achievable information of a low-priority packet. (For. both types of 
traffic the output address is 8 bits long.) „..^k »h=t in the .statistical 

Another statistical test setup is to send packets randomly from various inputs such that in the 'St ^al 
mean a deJined traffic load and ratio between high and low-priority traffic constitutes at the outputs. In this 
case the mean content of information per packet is calculated to be: 



so Ho - 



hx56-t-(^)x248 



- bits per packet , [H] 



55 



where h [%] and I [%] are the contributions of the high and low-priority traffic * f^^^ 

respective y The tota traffic load on an output port is h . I. which may never exceed 100%. The fraff.c 
oadlSes the ratio between packet traffic and pauses. It is to be noted that, ^^^'f^^'^.^^^^^ 
sZe hiqh and low-priority loads, the number of low-priority packets is one-fourth that of »^'9hP"0"ty 
STkets When the information rate is normalized to a constant time unit equal to the duration of a high- 
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10 



35 



priority packet (i.e. 2 us), one obtains: 

h X 56 + ( ) X 248 



Ho = 



Too [12] 
h X 56 -h I X 62 



bits per time unit 



100 

Wlien t [s] is the duration of the test sequence, T becomes 



2x10^ 2 

To give an example for how long an output of a switching system must be analyzed to ensure with 
99.9% confidence that the probability of a system defect to occur on a path to a given output is less than 
20 10~^°, where the mean total traffic load is assumed to be 90%, with a contribution of 60% high-priority 
traffic and 30% low-priority traffic: 

The information per time unit is calculated to be: 



25 . . 60 X 56 + 30 X 62 

100 



_ X -t-^ou X _ 52,2 bits per time unit . [14] 



With ttmax = 10"^° and Q = 0.999, Fig. 8 provides the required information of HoT«10^^ bits. With 
30 equation [13] one finally obtains: 

t = 2 ^ 1°^1 = -[7-10^ = 3831 s « 1 hour. [15] 
HoXlO® "o 



After the presentation of a formal way to verify the dynamic functional behavior of novel types of high- 
performance packet switching systems in real time, with the inclusion of time-variant system defects, which 
may occur randomly, the following describes the architectural considerations and functional aspects of an 
40 implementation of a testing-based verification system in accordance with the present invention. An important 
design goal for the verification system is the applicability to various switching systems which differ in the 
number of input and output ports. No doubt, most flexible and generally applicable is a multi-processor 
implementation which offers for each input port and for each output port of the switching system a separate 
microprocessor. 

46 Fig. 10 shows the overall structure of the verification system which comprises an environment portion 
14, a result analyzer portion 15. and a global controller portion 16. All of these portions are made up of so- 
called transputers, commercially available, versatile and powerful processing units which can be easily 
connected to form networks. A detailed description of the transputer architecture and its features can be 
found in "Transputer Reference Manual" INMOS Limited, Prentice Hall, 1988. 

50 Briefly, a transputer (Rg. 11) Is a one-chip microcomputer with its own local memory 17 and with 
communication links 18...21 for direct connection to other transputers. In addition, each transputer contains 
special service circuitry 22 and an external memory interface 23 which allows to access additional memory 
or to control peripheral hardware. All components of a transputer are integrated on a single VLSI chip. A 
significant feature of transputers is that point-to-point communication links allow the construction of 

55 transputer networks of arbitrary size and topology. This feature avoids the specific problems that occur 
when all involved processors are connected by a single bus (e.g. limited bandwidth of the bus; electrical 
problems related to driving capabilities of buffers; necessity to have additional control logic for the access to 
the shared bus). The fact that each transputer in a network has Its own local memory ensures that the 

15 



BNSOOCIO: <EP_0504537A1_L> 



EP 0 504 537 A1 



75 



20 



25 



access memory 17 for high-speed P'°^®f 7"«r' ,^ IMS-T800 transputer has a 32 bit CPU with an 

a programming language is OCCAM wnicn anowt, OCCAM is used to program an 

used to program a single transputer or a ^f'-^'l^ll^^'^^^^^^^^ communi?ation is 

individual transputer, the transputer shares its ^''"^ J^^J^^AM^j^^^^^^^^^^^ a transputer network. 

Tarrpr OCCA. processes on 

different transputers is implemented directly ttje senal ♦^^f J'jf ^.^s. While a connection 

The packet switching JVje- ^-^^^^^^ J,,, serial communication 

Mbit/s on the links. A 20 MHz transputer clock corresponds to a 'J^l ^.^^^ ^ata bus 

operation to the — 

:rtr~trg"s:r^^ 

memory interface 23requires at least some ^-^L to ECL) adaptation on the 

separation between transputer and switching system, and for signal level (i.e. i i no 

the result analyzer are reported to the contro ling Ya"spuier °aseo commands for the 

„ eoncel..bte lh« one transputer cen control f^>' 'f '"^ ^^.^ing eKh byte out ol 

Tneoret.-, one tr^spute- ^^ZT<'^«~^^''^^'"^ '^ ")! 
its local memory 17 in real-time, practicaiiy, now«vc;.. . ^"^^ ^ a status report when low priority 

transmission of bytes and could not provide any pcJ? The process that 

packets have to be retransmitted because ? °"'j3^*3^^^^^ it is preferred to 

« generates the test packets has to be ^^^^^.f fjf^^^^^^^^ loclns at the 

perform some pre-processing activities which store tl^e/^*' P^^^^ J^^^ ^^a^s^rt a test packet, the 
transmitter hardware rather than in the ^/"^P^^^^ 

~-:h^ir^^^^^^^^^ 

trardware 24 in the environment portion t4 anO ''^^^'^^'^^Zs^^Zl^VM l»rte. Eaoh 
^"ZrZZ^rS^.ZT^rZ, pSt-i test aat^ o. to an.W» 
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the responses of an output port in real time, and for each input port as well as for each output port identical 
input test resources, and identical output test resources, respectively, are provided. 

A port carries the following three signals: the data signal, a packet delimiter signal that indicates when 
the data signal carries valid data, and the backpressure signal that indicates overload conditions at the port. 
5 Only the data signal transmits the high-speed (32 Mbit/s) data. The logic values of the other two signals 
change with significantly lower frequencies. 

The transmitter and receiver units 24, 25 are designed in a way that one transputer can control from 
one to 16 units. The front end of the transmitter and receiver hardware performs the signal level adaptation 
to the switching system. The time-uncritical applications of the verification system, namely the global control 
70 of the system and the test case generation, are implemented in software on the T800 transputer 26. The 
T414 transputer 27 serves as communication node between the T800 transputer 26 and the two T212 
transputers 28, 29. 

The control logic for the transmitter and receiver hardware 24, 25 can be designed as a collection of 
communicating finite state machines. In one part of the verification system it may be useful to have 
T5 concurrent processes executed by OCCAM programs and performed by transputers, and in another part, 
concurrent processes may be designed as finite state machines and implemented in hardware. The design 
of the hardware control logic as a set of communicating finite state machines contributes to the efforts to 
form a homogeneous system performing concurrent processes on a multi -transputer network with additional 
specialized hardware. 

20 Based on the architecture of the verification system shown in Fig. 12. first a description of the functional 
characteristics of the entire verification system, and then of each of Its major components will be given. The 
Switch Fabric Adapter (SFA, cf. Fig. 5) serves as interface between the external worlds of circuit switched 
traffic and packet switched traffic, and the internal world of two types of fixed-length minipackets. The actual 
switching system, the Switch Fabric (SF), operates exclusively on the minipacket traffic. By connecting the 

25 verification system directly to the SF, the SF becomes accountable for all observed errors. The SFA, a 
potential source of errors for the entire switching system, can be excluded because it is not in the 
verification path. 

To perform a successful and comprehensive verification of complex switching systems, several 
independent levels of verification should be pursued: 
30 • The basic functional behavior of the switching system is checked during simple interconnection 
tests by sending single packets through the system and explicitly checking whether each packet 
arrives correctly at Its destination port. A packet buffer that temporarily stores a fixed number of 
incoming packets permits a detailed analysis of the received packets during a post-processing phase. 

• Behavioral tests are performed during continuous test runs with randomly changing traffic mixes and 
35 under various loads as thoroughly as practical. This verification mode aims at the detection of 

transient manufacturing faults and hidden design errors which may occur with a very low probability 
(even below 10"^). 

• Resolution tests provide detailed diagnostics on whether a system satisfies particular requirements. 

• Performance tests measure the performance characteristics off the switching system under test, such 
40 as. e.g. the maximum throughput of the system, or the mean transit delay of successive packets. 

• Robustness tests are performed to determine how well a switching system under test recovers from 
various error conditions. The reaction of the system to unusual or invalid Input data is of particular 
interest. 

While the nominal clock frequency of the packet switching system was assumed to be 32 MHz, the 
45 hardware design of the switch would allow the system to be driven with any lower clock frequency, down to 
single step mode. In case of a system malfunction, the operation of the system with a slower clock 
frequency is helpful in detecting whether the malfunction is related to timing problems. 

The transmitter hardware and its controlling transputer (see Fig. 12) form the environment portion of the 
verification system. Each transmitter is associated with a specific input port and provides test data for that 
50 input port. Fig. 13 shows a block diagram of a typical transmitter hardware. 

Since the switching system has to process two different types of traffic with different characteristics, It is 
natural to store the test packets of high and low priority traffic in separate RAMs. The 8 kbyte RAM 30 can 
hold 256 low priority packets at maximum (256 x 32 byte = 8 kbyte). In order to have the same starting 
addresses for the high priority packets as for the low priority packets, the high-priority packet RAM 31 Is 
55 also filled with 256 packets. During one test setup, these 256 different high-priority packets and 256 
different low-priority packets represent the stock of available test data. 

The following two approaches are recommended for the generation of test traffic with specific 
characteristics from the stock of prepared packets: 
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o In the so-called transputer mode, the transputer controls the transmission of P^^J^^s/^^ f;* 
priorities in real time. The intervals in which the transputer sends the start addresses of the packets to 
the transmitter (call-by-addressi) determine the timing charactensfc of he resulting t^aW-c^Smce the 
transputer network and the switching system are running with diHerent c ocks. '^^"^P"*^'^!,^ ^2 and 
switch clock 33. FIFO elements 34. 35 are used to support a clean clock separa .on m the transmitter 
hardware. Transputer clock 32 controls the writing of the packet addresses into the F^Os 34. 35, the 
Clock 33 of the switching system controls the reading of the addresses out of the ^^^Os 34 35 and 
the transmission of the associated packets. Thus, for each type of traffic, a separate RAM 30.3 (to 
sJore^he contents of the packets) and a separate FIFO element 34.35 (to store the addresses of the 
10 oackets which are sent out next) are provided. ^ . .♦^r.r. 

o Tn the retransmit mode, the transmitter hardware controls the transmission of the Packets au ono^ 
mous% without any transputer interaction. The information about the desired distribution of the 
packtte over time is loade'd into the high- and low-priority FIFOs 34, 35. respect^ely dur.^^ a Pre- 
processing phase. The transmitter control logic permits repetitive reading of the conten s of the 
F FOs Pauses are generated in that out of the nine bits the FIFO data bus contains, eight bits are 
ledto address one Of the 256 possible packets. A logic high in the ninth bit indicates a pause afte_r 
the current packet, and the next FIFO entry contains the length of the pause m -^""'P'es of 2 as - 
ength of a high priority packet). This feature ensures an efficient use of the memory space of the 
FIFOs 34 35 A pause between succeeding frames, independent of its length, requires only one 

The «mra Tra^spuTe? requires to perfom. the necessary instructions to send one address byte to the 
transmCand\o trigger in this way the transmission of a packet, is at least ^ The ^ansp^^^^^^^^^^ 
has to load the 8-bit address word (100 ns) and the number of the destination transmitter (50 ns) into ite 
internal reaisters It then has to write the address word to the external memory interface (ifO ns). Under 

as wTrcase'ctditio^^ 'f all attached transmitters have to send high priority traffic with 100% load), a single 
tran^outer can serve UD to (2 us / 300 ns = 6.67) six transmitters in real time. 

Eve" 2 us (the length of a high priority packet) one byte must be written into each transm.tter^or each 
transSr must be se^ed with 0 5 Mbyte/s. The maximum data rate of the external memory '"terface is 
i^tld to 10 Mbyte/s (80 MbiVs). These 10 Mbyte/s would be sufficient to serve 20 t^an^^^'^^^^-f 

30 Mbite/s For a switching system with more than six inputs, therefore, at least a part of the t;ansrT^'«;;^'^"^ 
be operated in retransmit mode if only one transputer is available. The possibility to switch dynamicaNy 
S^t^eeTboth operation modes, transputer mode and retransmit mode. -^"-^JJ^tsTnotroS^^^ 
flexibility of a setup where some transmitters are running in retransmit mode, and others (not more than six) 
are operating under real-time control of the transputer. »,i«^,«„„ c««i«m 

35 It will be clear to those skilled in the art that the transmitters required for any verif cation system 
includi:; the one of the present invention, can be built from commerciaHy -^'f^J '"^Sf^^^^^^^^^^^ 
arranoed for example on a printed circuit board. All finite state machines of the control logic can be 
rmTemlntld TsoSiled programmable array logic (PAL). These devices typically have a maximum 
pXgatrn dl^y of 15 ns and can be clocked up to 50 MHz. All of the (e.g. 10) outputs o^ each P^^ can 

^ be Reconfigured \o act as inputs. Thus, it is possible to define up to ^^"^"^^./"l^LTorodu^tt^^^^ 
outputs is user-programmable for either registered or combinatonal operation. The number of product terms 

'"rstllgTforte t^^^^^ av^lable CMOS static RAM 30. 31 organized as 8K.9 

with'^tZm'iretJ time'of 45 ns may be used. The base addresses of the ^^^^^^^^ 
» rMOS narallel-serial FIFO 34, 35 containing a RAM array organized as 4Kx9-bit. The parallel por^^access 
Le^fso'ns and the divic^^^^^ be clocked up to 40 MHz. allowing asynchronous as well as simultaneous 

"'Vh:^"e;^e^htdware and its controlling transputer represent the result analyzer portion of the 
verifLation system Similar to the transmitter hardware of Fig. 13. the receiver ° 
identLl functional units, called receivers. Each receiver analyzes the data ^^^^^^ 
the sWitchino svstemin real time. Fig. 14 is a block diagram with the basic components of a s'nfl e receiver. 

A ^SSrl ofT2 MbiVs per output port requires a hardware-based evaluation of the output data of the 
switch n^fyie^. D-ifferent error checkers%6...39. a packet buffer 40 and a ^^:;^<>!'-^-'^'' ZTT.sV^l 
o^m the'kernel of each receiver unit. The error checkers 36...39 ♦""^^f^^"]' '"^^^^^^^^^ 
55 are operating concurrently. Each error checker 36...39 extracts pertinent "^tormation out of the incoming 
data stream performs the necessary evaluations, and decides whether a packet has been switched 
coric^rrnot. The error checkers 36...39 are entirely implemented in '/'^^VZ^X^^^^^^ 
critical tasks of the result analysis. A transputer interaction is only required if one or more of the following 
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events occur: 

1. At least one error checker 36.. .39 has detected a malfunction of the switching system during the 
examination of the data stream. 

2. The performance evaluation unit 41 triggers a transputer process which measures the transmission 
5 time of packets and performs some additional statistical computations. 

3. The user requests status information of the receiver hardware or wants to read the contents of the 
packet buffer 40. 

Since transputer interactions initialized by an error checker 36.. .39 or by the performance evaluation unit 
41 may trigger time-critical tasks, they are handled with a higher priority than a user request for some 
10 status information. In order to get a clean separation between the two clocks involved, the control logic for 
the receiver is split into two independent parts: one unit 42 operating with the clock of the switching system, 
another unit 43 operating with the transputer clock. 

The functional independence of the error checkers 36...39 allows a modular design (i.e.. each checker 
can be designed separately) and a stepwise implementation of the receiver hardware. In the following, the 
75 error checkers 36...39 are describedin more detail: 

The task of the length error checker 36 is to detect packets with incorrect length. The data stream from 
the switching system is accompanied by a packet delimiter which carries a logic low signal during the 
transmission of a valid packet. Length error checker 36 extracts the type bit of an arriving packet (which is 
used to distinguish between a 64-bit high-priority packet and a 256-bit low-priority packet), counts the clock 
20 cycles during which the packet delimiter stays low, and decides whether the received packet has a correct 
length or not. 

The task of the cyclic redundancy check (CRC) checker 37 is to detect corrupted packets. The test 
case generator inserts a 12-bit CRC code at the end of each packet. CRC checker 37 starts with the falling 
edge of the packet delimiter signal. When the packets arrive without errors, the output of CRC checker 37 
25 transits to logic zero, with the rising edge of the packet delimiter at the end of each packet. If the error 
output stays at logic one. a CRC error has been detected and is reported to the control logic 42. 43. 

The task of sequence number checker 38 is to detect lost packets, packets that arrive in wrong 
sequence, and duplicated packets. In order to check the correct sequence of packets that originate from the 
same transmitter source, sequence number checker 38 extracts the sequence number as well as the source 
30 address of the packet out of the incoming data stream. 

The task of port number checker 39 is to detect packets which are switched to a wrong output. Checker 
39 compares the four-bit destination identification of each packet with a receiver address which has been 
assigned to each receiver unit during the initialization phase of the verification system. 

Fig. 15 shows a block diagram of a sequence number checker 38. The source address serves as RAM 
35 address under which the expected sequence number of the actual packet Is stored in a RAM 44. The 
expected sequence number is compared (45) with the sequence number extracted out of the packet. If the 
numbers do not match, an error is reported to the control logic. The extracted sequence number is 
incremented by one (46) and stored in RAM 44 under the same source address location. The fact that the 
sequence number that was extracted out of the actual packet is incremented by one ensures that bursts of 
40 errors are avoided in case only one packet was lost. Sequence number checker 38 is used to detect the 
following types of errors: sequence error, packet loss, and packet duplication. 

The task of packet buffer 40 is to continuously keep a user-controlled stack of the packets that most 
recently arrived. The size of the stack may vary from zero to the maximum amount of available memory 
space of the storage medium. A 4 kbyte FIFO is sufficient to hold between 128 (only low-priority) packets 
45 and 512 (only high-priority) packets. If a command to fill the FIFO is triggered by an error signal, the FIFO 
contains sections with pertinent information about the following special periods in time: 

- Packets which arrived before the fill command was given to the FIFO originate from a period in time 
where the switching system was operating as expected and no error was observed. 

- The erroneous packet, that indirectly caused to fill the FIFO, is stored. 

50 - Packets which arrived subsequent to the faulty packet fill the rest of the FIFO. 

A subsequent examination of packet buffer 40 facilitates the identification of the faulty packet. 

The task of the performance evaluation unit 41 is to support the characterization of the dynamic 
functional behavior of continuously operating high-performance switching systems under various traffic load 
conditions. The relative transit time between packets, which have been inserted into the switching system 

55 back to back at the transmitter, is one significant indicator for the performance of the system. The total 
transit time Tp<j for high-priority packets can be composed from the partial times associated with the 
performance of the individual functional components of the switching system. The time a packet needs to 
pass the autorouting tree can be neglected, and is. therefore, set to zero. The control logic transmits only 
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^ , , ^„ eo to the Queue element and it takes 2 us until a complete high-priority packet 

queue for the time T^o . Thus. 



5 + T 



Ou 



[16] 
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The time depends on the actual number of already queued packets (queue_length). or in general, 
on the amount of traffic from other transmitters to this output: 



IS 



Tqu = queuejength x 2 ;iS . 



[17] 



Ir, case of low priority traffic, the time Tbp during which the packet is backpressured (because the output 
queue is filled) adds to the total transit time Tpd. 
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The transmitter is forced to insert a low priority packet immediately after a high priority packet. If no 
other transmitter sends high priority packets to the output of interest, the delay time of the high priority 
packet in the output queue can be neglected. The total transit time of the high-priority packet is reduced to 
S\ The point in time at which the high-priority packet starts the time measurement process in the receiver 
5 transputer is taken as approximation for the point in time at which the low-priority packet is inserted into the 
switching system at the transmitter, or, if the uncertainty 5' is very small compared to the time the low- 
priority packet is backpressured and the time the low-priority packet is delayed in the output queue, then 
the measured time Tabs is nearly the same as the absolute transit time Tpd. 

Each receiver unit may be implemented on a printed circuit board. The FIFO, used as temporary buffer 
10 for all received packets, and the RAM 44, used to store the expected sequence numbers of the next 
incoming packets, are the same devices as used for the transmitter. PALs are used to implement the finite 
state machines. 

The entire software for the global control of the verification system (Rg. 12) and the semi-automatic test 
case generation are running on a commercially available IMS T800 transputer 36. The Personal Computer 

75 (PC) 47 operates as a terminal for data entry (via the keyboard) and data presentation (via the screen). The 
IMS T414 transputer 27 acts as a communication node between the T800 host 26 and the T212 transputers 
28, 29 of the environment and result analyzer portions 14.15, respectively. 

The task to generate test cases is completely independent from the task to perform the verification and 
characterization of the switching system, and could be implemented separately. In the verification system of 

20 the present invention, the semi-automatic test case generator is located at the T800 host transputer. The 
test case generator is a kind of interface between the test method and the part of the verification system 
that performs the system evaluation. Its main tasks are to support the user during the specification of 
abstract test cases, and to compile the abstract test cases into executable test cases suitable for the 
verification system. 

25 At the system level of abstraction, test cases for fast packet switching systems consist of sequences of 
test packets with different priorities, simultaneously sent under various loads from several inputs to several 
outputs of the switching system. The following three independent applications controlled by user inter- 
actions are used to generate the required executable test cases. Fig. 16 shows the different sources used 
for the test case generation. 

30 A Switch Configurer 48 is used to specify the physical configuration of the switching system to the test 
case generator. A Config file 49 contains the total number of inputs and outputs, the number of stages the 
entire switching system comprises, and the routing information on how all these stages are interconnected. 
Config file 49 is used by a Message Generator 50 to place the output address (or addresses in case of a 
multi-stage system) of a packet at its correct position inside the test packet. 

35 Message generator 50 receives inputs relative to the assumed fault path for which the test packets are 
generated, the traffic priority, and the name of the relevant configuration file. Based on these inputs, a 
message is produced which contains all required information to detect the system errors described as 
"Target Errors". A message is defined as a sequence of packets, all originating at the same input and 
intended for the same output. Message generator 50 determines the contents of the test packets, and thus 

40 also the contents of the RAMs 30,31 in the transmitter units 24. 

An example of how message generator 50 compiles the formal notation of a specific test path in a 
specific switching system into a message consisting of 16 test packets is shown in Rg. 17. High-priority test 
packets have eight bytes represented by eight pairs of hex-characters. The first and third arrow in Rg. 17 
(the arrows are ordered from left to right) point to the destination address of the packet (outport 2). The "8"- 

45 character in the column of the second arrow indicates high-priority packets. The fourth arrow points to the 
source address of the packets (Inport 1). The last but one arrow points to the sequence number of the 
packets, and finally the last arrow points to the 12-bit CRC code. 

The task of packet scheduler 51 is to schedule the packets of several messages in a way that a certain 
load and a certain mix between high- and low-priority packets is established. Basically, packet scheduler 51 

50 generates ordered lists of addresses which are loaded to the appropriate FIFOs 34. 35 (Fig. 13) and used to 
call out the packets from the respective RAM 30, 31. The task of the environment is to ensure that the 
precalculated test packets are applied to the switching system in the same manner as It is specified in a 
schedule file 52. The test case file 53 is the end product of the test case generation representing the 
executable test cases. The contents of this file 53 can directly be loaded into the transmitter hardware. 

55 The config. message, and schedule files 49. 52. 54 containing the abstract representation of the test 
cases can be regarded as library files. The completeness of these libraries determines the entry point for 
the user interaction during the semi-automatic test case generation. For example, if there already exist 
configuration files for all possible switch configurations, the user can directly start the test case generation 
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""ATwTarrodeKcaned the Path Fault Mode.) is being proposed to f 

of nacket switchlna systems at the system level of abstraction. The fault model does not restrict the 
Surber Of s^u'^^^^^^^^^ active faults in a system, and considers also transient system detects w^^^^^ 
may occur with error probabilities even below 10"^ Describing packet sw.tch.ng systems at the 
rj^em^everof abstraction with paths and packets, and regarding the paths as '""•^^'O"^' PJ'^^f^f^ 
responsible for a misbehavior of the system, reduces the number of potential errors and. thus, makes 
a subclass of sequential systems amenable for verification approaches. 

- Based on the Path Fault Model is the test method for fast packet switching systems '".accordance 
wS the present invention. The central idea of the test method is to insert all infomiation wh.ch .s 
rZired a^d sulficient to decide. - at the output side of the switching system. - whether a packet has 
been handled correctly or not. into the payload part of each test packet. ♦ , .^„,ti 

- To enable the performing of the formal test method in accordance with the '^ention a mult.- 
iLessor-based rrr^plementation of a verification system is proposed to verify and character.ze the 
KaS swSl, faS:. Of fast packet switching systems in real-time The P-^-ed 'mple^^^^^ 
consists of four transmitter units and one receiver unit. Each unit Is able to process (send or analyze) 
a continuous data stream of 32 Mbit/s in real-time. 

L eSnrinformation theoretic approach to test complex systems by statistical means has been 
adaS to the peculiarities of packet switching systems. The approach delivers f ^rox-ma^on fo 
fhe Speriod one has to offer in order to reach a certain degree of confidence that the probab.l.ty of 
the svstem to fail does not exceed a certain upper bound. 

A form? notation for abstract test cases has been defined for fast packet sw.tch.ng systems. These 
ablrct tS cies are automatically transformed into executable test cases which can be processed 
with the preferred implementation of the verificat.on system. . ^ . ^ .^Kn. i« fr«« <with a 

The detailed system verification permits the statement that the integrated sw.tch fabnc .s free (w.th a 
TmS error probability for the system to fail of less than 10-) of design and "^an^factur.ng 
erm^ and t °Jt the actu^ operational behavior of the system conforms to that establ.shed .n the 

ThTcoIiceptual approach to describe packet switching systems with paths and packets at the system 
30 leve^of abSac S (Path Fault Model) is applicable to packet switching systems ,n genera and .s rK,t 
" ::tctIdTfast packet switching systems only. The proposed test f '^j' 

required to determine, -at the destination of the packet- whether or not . ^^''^ 
assumes that there is sufficient space in the payload part of each P«<=,'*«V°J"^^^f ^^^t^^^^^^ 
seouence number the input address, and the time-bits. The 48 byte payload s.ze of an ATM cell that w.n 
3a become an i^^^^^^^^^ o«ers the possibility to insert even further information. I.ke an ent.re t.me 

'''7^:ZZT::::T7T^^^^^^^ f-ework tor the architecture of the verification 

systim oZs he pos ibility to extend the system easily in terms of -^^»r^'''"T'?r:eTt is"S 
S wXthe architecture of the transmitter and receiver units of the preferred embodiment .s stnctly 
^ "^Z^Z Ss? pack": switching systems, with the integrated switch fabric -^^eing Jsigne^^^^^^^^^ 

Xt^oJs Tme arcSlS of the systL 'environment (transmitter) and in the result analyzer (rece.ver) 
Principally the behavior and resolution tests are performed under traftic Patterns which consist of 

finite state machines, and these are implemented in programmable array logc P^^) de^'^JJ;^^^^^ 
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accesses. 

One task of the global controller is to connect the transmitter (or environment) portion of the verification 
system with the receiver (or result analyzer) portion. During operation, a special event on the receiver side 
(for example, an observed error) can force an interaction at the transmitter side via the global controller (for 
5 example, an interrupt of the transmission). Compared to the data flow from the transmitter to the receiver via 
the switching system (i.e., the verification path), the data exchange between global controller on one side, 
and transmitter and receiver on the other side can be neglected. 

Practically, if the transmitter is assumed to operate in retransmit mode, once transmitter and receiver 
are initialized in a preprocessing phase, they operate autonomously without interaction required from the 
10 global controller. Therefore, it is conceivable to place the transmitter and receiver portions at geographically 
distant locations of a fast packet switching network, and to have, thus, a formal basis to verify and 
characterize Metropolitan Area Networks (MANs) and even Wide Area Networks (WANs). 

It is believed that with the increasing complexity and line speed of telecommunication systems, the 
necessity to have formal approaches to verify and characterize the dynamic functional behavior of 
75 geographically distributed switching nodes and networks appears to become more and more indispensable. 
It Is also conceivable to integrate the verification system of the present invention into existing switching 
systems. The motivation to do this is to verify and characterize the behavior of these systems under normal 
operating conditions. Where transmitter and receiver units are distributed to different locations of the 
switching network, and the special addresses of the receiver units in the network are known to the 
20 transmitters, the latter periodically send an adjustable load (the toad should be made adjustable depending 
on the utilization of the network) to the receivers and perform thus a partial verification and characterization 
of the network during regular operating conditions. 

Claims 

1- Method for testing and evaluating the dynamic functional behavior of geographically distributed 
telecommunication networks, in particular fast packet switching networks comprising a plurality of 
transmitting stations, receiving stations and communication links connecting those stations for the 
transmission of traffic organized In the form of packets, wherein the packets contain a control block and 
a payload portion, the latter being devoted to carrying the user information, characterized by the 
following steps: 

- defining the primitive functional building blocks, such as paths, between the inputs and outputs of 
the network. 

- defining a set of target errors which the testing and evaluation is supposed to detect. 

- passing, during a testing and evaluation phase and/or during normal operation of the network, test 
packets around the network which contain, in addition to the information normally contained in 
their control block, in their payload portion all information relevant to their testing and evaluation 
task, instead of the user information normally contained in said payload portion, and 

- analyzing the test packets arriving at the output port of their path of transmission for any 
unexpected results. . 

2. Method in accordance with claim 1 , characterized In that the Information relevant to the testing and 
evaluation task of the test packets and contained in the payload portion of the test packets comprises 
at least an input address, a sequence number, time bits, and a cyclic redundancy check (CRC) code. 

45 

3. Method in accordance with claim 1 , characterized in that the information contained in the control block 
of the packets at least encompasses an output address and a type bit. said output address defining the 
destination of the packet, said type bit Indicating the priority level associated with the packet. 

50 4. Method in accordance with claim 2, characterized in that said input address defines the source of the 
test packet, that the sequence number Indicates the order In which the test packets are sent out from a 
particular source, that the time bits define the transmission delay of the test packet through the 
network, and that the CRC code ensures the correctness of the entirety of the information contained in 
the control block and in the payload portion of the test packet. 

55 

5. Method in accordance with claim 1, characterized in that said set of target errors is defined to 
comprise at least two of the following: packet loss, packet duplication, packet arrival in wrong 
sequence, packet arrival at wrong output, packet arrival with wrong packet length, corrupted packet 
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6. 



8. 



10 



11 



contents, wrong packet delay. 

°* -''requTnce number and input address for the determination of packet loss, packet duplication, and 

. of amva. of a test packet at a wrong oUput; 

. S5e bit for the determination of a packet arriving with a wrong packet ength 

- Se b ts for the determination of a packet arriving with a wrong packet delay, and 
: code for the determination of a packet arriving with corrupted packet contents. 

•»h ^i,im 1 Characterized in that sequenceis of test packets are simulta- 

varied between any two successive transmissions of test packets. 

.loim 1 rharacterized in that the test packets prior to their transmission 

by the transmitter hardware control logic. 

•.h .i<,im 1 Characterized in that the test packets have a fixed length 
Method in accordance 1^1;^^.;;^^^^'^^^^^ for high-priority voice traffic the test 

ltZZ^-^st.Xs:ZZ f^Morpriority data traff.c *e packet length is 53 bytes. 

verification apparatus for testing and -aiua^n^^^^^^^^^^^^^ 

distributed telecommunication networks, m particular Pf those stations for 

ities of transmitting stations, receiving stations 7^/°"^^"^";;2acfeJrzed^ a system 

the transmission of traffic organized in the form of Pf^^^^f '^^^^^^^^^^^ generation portion, 

environment portion, a result .^"^'V^^P^^'^";^^ ^^''^ transmitters a^^^^^^^ each with an input port 

said system environment P°2'°77'"*"9J P'"^"^'^ portion including a plurality of 

ric^e^ts ^^e;;;^^:^^'^^ ^ p°- - - --^^ — 

verification apparatus in accordance with ^^^^^^l^^^ eafh 
receivers are designed as transputers ^uch th« one Wuter .s -no y 
input port and with each output port of the ^T^Ta second control transputer is 

connected to the inputs of all transputers ^^JJ^J^^^l a^d'thTsaid global controller comprises 

apparatus and/or the test case generation. 

. „ r„rrs rr^ss rrr-^srSc-r. 
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to the associated output port of the packet switching network to be tested and having parallel outputs 
respectively connected to a plurality of error checkers (36.. .39) each dedicated to at (east one of a set 
of predeternnined target errors, to a packet buffer (40) and to a performance evaluation unit (41), and 
that the outputs of said error checkers (36. ..39), said packet buffer (40), and said perfornnance 
s evaluation unit (41) are connected to the inputs of a second transputer clock-controlled receiver 

controller (43) connected in turn to an external memory interface (23). 



70 



75 



20 



25 



30 



35 



40 



45 



50 



55 



BNSDOCID: <EP_0504S37A1J_> 



EP 0 504 537 A1 




¥■ 




FIG. 3 




BNSOOCID- <EP_0504537A1 J_> 



26 



EP 0 504 537 A1 



Router 



Buffer 




Concentrator 



FIG. A 



32 BYTE CELLS 




USER 
PACKETS 



84 kb/^ 



SWITCH 
FABRIC 
ADAPTEH 




SWITCH 
FABRIC 




32 Mb/9 



FIG. 5 



32 BYTE CELLS 
J 




84 kby^ 




SNSOOCID: <EP_0S04S37A1_I_> 



27 



EP 0 504 537 A1 



CS/ATW 




PS/ATM 





ATM TRUNK ■ 



SWITCH FABRIC 



Km/Ant 



SFE 




SFE 




sfeT 












SFE 


Y 


E 


Y 














SFE 








SFE 












/ 




\ 

\ 





1 ! 
1 


ATU/CS 




ATM/PS 



^T>4/ATM 



► ATM TRUNK 



/ 




FtRJ CONTROL 



SWITCH FABRIC ELSi/lENT 

FIG. 6 



BNSDOCID: <EP_0504S37A1_L> 



28 



EP 0 504 537 A1 



PIG.?/ .• / . e ■ 

/ S . t / S . C . t 

/Ts. i / s.Nr.i 
/Ue. b / Te.Ee.b. 
/Pr. e / Ur.Ub.E. 
/Td. P / Pd.Qm.M. 
/Ud. Y / Nd.Eu.I. 
/OA. T / lA.SN.T. 



Control 



Payl oad 



/ 

/ 

7 

/ / 
/ / 
/ / 
. c / / 

R / / 
C / / 



/ 



/ 



packet length 



HP ■- 
LP •■ 



-♦I 1 frame 



-**| 16 slots 

•< *•! 64 slots 



FIG.8 



Time 



Q-0.99 




FIG. 9 



1 10 10^ 10^ 10"^ 10^ 10^ 10^ 10^ 10^ 10 

HoT (bits) 



10 



10 



12 



BNSOOCID: <EP_0S04537A1_L> 



29 



EP 0 504 537 A1 





BNSDOCIO <EP 05O4537A1_L> 



30 



EP 0 504 537 A1 



26^ 









i 



















T800 



FIG. 12 



11 



T414 





Switching System 




FIG.K 



External Memory Interface 



BNSOOCtD: <EP_0504537A1 J_> 



31 



EP 0 504 537 A1 



External Memory Interface 




Switching System 




BNSDOCID <EP 0504537A1_L> 



32 



EP 0 504 537 A1 



U 
s 
e 
r 

I 

n 
t 
e 
r 
a 
c 
t 
i 

a 
n 



FIG.16 




INPUT: 


OUTPUT: 


message HpTest; 


{ 92 


S2 


61 


00 00 06 


oc 


70 


switch • "XhypertesXColumbus"; 














priority ■ high; 


02 


82 


01 


00 00 00 


14 


7F 


path ■ { i nport 1 to outport 2 ) ; 


62 


82 


01 


00 00 00 


24 


61 


packets ■ 16; 


62 


82 


81 


09 66 66 


3C 


6t 


emessage; 


02 


82 


01 

• 


00 00 00 

» • 


4C 


52 




62 


82 


61 


00 00 00 


£4 


43 




02 


82 


01 


06 00 00 


r4 


25 


FIG.17 


} 

A 


AA 


A 




AA 





i i I 



\ i 



8NSDOCID: <EP_0SO4537A1J_> 



33 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



DOCUMENTS CONSIDERED TORE RELEVANT 



Cstefory 



CkadoD off 



off retevant pacBlo 



US-Ar4 617 663 (C.J.IAKE ET AL) 

• column 2. 11n« 11 - coluwi 3. line W 

• colum i. line 6 - Une " * 

• colum 6, Una 55 - column 7, line 52 

• colum 8. lln* 36 - line 50 * 

• figures 1,12 * 

US-Ar4 745 593 (G.M. STEWWffl) 

• colu-m 2. line 61 - column 4. line 18; figures 
1-3 • ^ 

US-A-4 486 877 (J.S. TURNER) 

• coluim 2. line 25 - column 3. line 44 

• column 16, line 14 - line 47 

• column 21. line 18 - line 65 



1 

11 



1-4 



EP 91 81 0203 



CLASSmCA-nON OF THE 
APPtJCATION 01. CtS ) 



H04L12/26 



mKNICAL FIELDS 
SCAKHEDOI-CLS) 



H04L 
G06F 
H04M 



Tbc pre 



t sewcb report has bee« 



1 

s 
8 



THE HAGUE 
CATEGORY OF CITED DOCUMENTS 

\ ^ SScutofly f^««»t If a»MM* with 

* Socuncot of th« sui« att^My 
A:t«i«ploglc«li»fk«^ 
O : noo-«rltMi dlsdosnra 
p : lotifflioiiat* ^ — 



up for lU 

IMi«lcM«MlM*ftkii>« 

26 OCTOBER 1991 



CANOSA ARESTE C. 



E : 9uA\m B«i«t 4oeuniB«, lai p"W»»« «»• 
-t-tbofiUi**-* 




BNSDOCID <EP_0504537A1_L> 



